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1. Introduction 
In many cases one is interested in solving operator equation 
(1.1) F(u) = h 

where F is a nonlinear operator in real Hilbert space H. Let us assume that 
equation (|1.1[) has a solution y, 

(1-2) F(y)=f, 

that the Frechet derivative F'(y) exists and is boundedly invertible: 

(1.3) || [F'iy)}- 1 1| < m, to = const > 0. 

Let us also assume that F'(u) exists in the ball B(y,R) := {u : \\u — y\\ < R}, 
depends continuously on u, and to(R) is its modulus of continuity in the ball B(y, R): 

(1.4) sup \\F'(u)-F'(v)\\=Lj(r). 

u,v£B(y,R), \\u—v\\<r 

The function u(r) > is assumed to be continuous on the interval [0, 2R], strictly 
increasing, and u>(0) — 0. 

A widely used method for solving equation (jl.ljl is the Newton method: 

(1.5) u n+ i = u„ - [F'(u n )]~ 1 F(u n ), u a = z, 

where z is an initial approximation. Sufficient condition for the convergence of the 
iterative scheme (|1.5p to the solution y of equation (|1 . ip arc proposed in pQ, [2], 
[3], [4], and references therein. These conditions in most cases require a Lipschitz 
condition for F'(u), a sufficient closeness of the initial approximation uq to the 
solution y, and other conditions ( see, for example, pQ, p. 157. 

In [4] a general method, the Dynamical Systems Method (DSM) is developed for 
solving equation (|1.2|) . 

This method consists of finding a nonlinear operator $(t, u) such that the Cauchy 
problem 

(1.6) u = $(*,«), u(0)=uo, 

has a unique global solution u = u(t; uq), there exists u(oo) = lim^oo u(t; uq), and 
F(u(oo)) = f: 

(1.7) 3\u{t), Vi>0; 3u(oo); F(u(oo)) = f. 
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Many examples of the possible choices of &(t,u) are given in [4]. Theoretical 
applications of the DSM are proposed in [6], [7]. A particular choice of <E>, namely, 
<f> = — [F'(u)]^ 1 (F(u) — h), leads to a continuous analog of the Newton method: 

(1.8) u(t)=-[^>(t))]- 1 (FKi))-/ l ), u(0) = u Q ; «(t) = ^. 

The question of general interest is: under what assumptions on F, h and uq, can 
one establish the conclusions (|1.7|) . that is, the global existence and uniqueness of 
the solution to problem (|1.8|) . the existence of u(oo), and the relation F(u(oo)) = hi 

The usual condition, sufficient for the local existence and uniqueness of the 
solution to (|1.8p is the local Lipschitz condition on the right-hand side of (|1.8p . 
Such condition can be satisfied if F'(u) satisfies a Lipschitz condition. 

Our goal is to develop a novel approach to a study of equation (|1.8|) . This 
approach does not require a Lipschitz condition for F' (u), and it leads to a justifi- 
cation of the conclusion (|1.7[) (with h replacing /) for the solution to problem (|1.8|) 
under natural assumptions on h and ito- 

Apparently for the first time a proof of convergence of the continuous analog (|1.8[) 
of the Newton method and of the usual Newton method (II. 5|) is given without any 
smoothness assumptions on F'(u), only the local continuity of F'(u) is assumed, 
see (fT4]) . 

The Newton-type methods are widely used in theoretical, numerical and applied 
research, and by this reason our results are of general interest for a wide audience. 

Our results demonstrate the universality of the Newton method in the following 
sense: we prove that any operator equation (jl.ip can be solved by either the usual 
Newton method (|1.5|l or by the DSM Newton method (|1.8p . provided that condi- 
tions (|1.2[) - (|1.4[) hold, the initial approximation uq is sufficiently close to y, where 
y is the solution of equation (|1.2p , and the right-hand side h in is sufficiently 
close to /. Precise formulation of the results is given in three Theorems. 

The basic tool in this paper is a new version of the inverse function theorem. 
The novelty of this version is in a specification of the region in which the inverse 
function exists in terms of the modulus of continuity of the operator F'(u) in the 
ball B(y,R). 

In Section[2]we formulate and prove this version of the inverse function theorem. 
The result is stated as Theorem [T] 

In Section [3] we justify the DSM for equation (|1.8p . The result is stated in 
Theorem |3l 

In Section 2] we prove convergence of the usual Newton method (|1.5p . The result 
is stated in Theorem [5j 

2. Inverse function theorem 

Consider equation (jl.ip . 

Let us make the following Assumptions A): 

(1) Equation ([Of and estimates (TO]) . (Ti~4"]) hold in B(y, R), 

(2) h£B(f,p), P=^^, 9 6(0,1), 

(3) mu(R) = q, q e (0,1). 

Assumption (3) defines R uniquely because u>(r) is assumed to be strictly in- 
creasing. We assume that equation muj(R) = q has a solution. This assumption is 
always satisfied if q e (0, 1) is sufficiently small. The constant m is defined in (|1.3p . 
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Our first result, Theorem 1, says that under Assumptions A) equation is 
uniquely solvable for any ft in a sufficiently small neighborhood of /. 

Theorem 1. If Assumptions A) hold then equation (jl.ip has a unique solution u 
for any h € B(f,p), and 

(2.1) ||[ F '( w) ]-i||<_^_, WeB(y,R). 
Proof. Let us denote 

Q := [F'(y)}-\ \\Q\\ < m. 
Then equation (jTTTJl is equivalent to 

(2.2) u = T(u), T(u):=u-Q(F(u)-h). 
Let us check that T maps the ball B(y, R) into itself: 

(2.3) TB(y, R) C B(y, R), 
and that T is a contraction mapping in this ball: 

(2.4) ||T(«)-T(«)||< ? ||«-t;||, Vu,veB(y,R), 

where q G (0, 1) is defined in Assumptions A). 

If (|2.2[) and (|2.3[) are verified, then the contraction mapping principle guarantees 
existence and uniqueness of the solution to equation (|2.2[) in B(y,R), where R is 
defined by condition 3) in Assumptions A ). 

Let us check the inclusion (|2.3|) . One has 

(2.5) h := ||u - y - Q(F(u) - h)\\ = \\u - y - Q[F(u) - F(y) + f - h}\\, 
and 

F(u)-F(y)= [ F'(y + s(u-y))ds(u-y) 

(2.6) Jo 



= F'(y)(u -y)+ [F'(y + s(u - y)) - F'(y)}ds(u - y). 



Note that 
and 



\\Q(f-h)\\<mp, 



sup \\F'(y + s(u-y))-F'(y)\\<u;(R). 

s£[Q,l] 

Therefore, for any u £ B(y,R) one gets from (jl.3|) . (|2.4p and (|2.5p the following 
estimate: 

(2.7) Ji <mp + muj(R)R< (1 - q)R + qR = R, 
where the inequalities 

(2.8) \\f-h\\<p, \\u-y\\<R, 

and assumptions 2) and 3) in Assumptions A) were used. 
Let us establish inequality (|2.4| : 

(2.9) J 2 := ||T(«) - T(v)\\ = \\u - v - Q(F(u) - F(v))\\ 



(2.10) F(u)-F(v)=F'(y)(u-v)+ [ [F'(v + s(u- v)) - F'(y)]ds(u - v). 

Jo 
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Note that 

\\v + s(u-v)-y\\ = \\(l-s)(v-y)+s(u-y)\\ < {l-s)R + sR = R. 
Thus, from (2J)|) and (|2~T0|) one gets 

(2.11) J 2 <muj{R)\\u-v\\<q\\u-v\\, Vu,veB(y,R). 

Therefore, both conditions (|2.3p and (|2.4p are verified. Consequently, the existence 
of the unique solution to (jl.ip in B(y, R) is proved. □ 
Let us prove estimate (|2.ip . One has 

[F'(u)}- 1 = [F'(y)+F'(u)-F'(y)}-' 

= [I+(F'(y))- 1 (F'(u)-F'(y))]- 1 [F'(y)]-\ 

and 

(2.13) \\(F'(y))~ 1 (F'{u) - F'(y))\\ < muj(R) < q, ueB(y,R). 

It is well known that if a linear operator A satisfies the estimate \\A\\ < q, where 
q E (0, 1), then the inverse operator (/ + A)~ x does exist, and ||(I + A)^ 1 ] < j^. 
Thus, the operator [/ + (F' (y))^ 1 (F' (u) — F'(y))]" 1 exists and its norm can be 
estimated as follows: 

(2.14) ||[ /+(j p' (y)) -i (j p' (u) _ F ' (y))r i|| <_!_. 

Consequently, (|2~T2|) and (j2~14|) imply ((2T|). □ 
Theorem [1] is proved. □ 

Remark 2. If h = h(t) G C 1 ([0,T]), then the solution u — u(t) of equation (|1.1|) is 
C 1 ([0,T]) provided that Assumptions A) hold. 

Indeed, if h = h(t), then a formal differentiation of equation (jl.ip with respect 
to t yields: 

(2.15) F'(u(t))u(t) = h(t). 

Since u{t) £ B(y,R), the operator F'(u(t)) is boundedly invertible and depends 
continuously on t because u(t) does. Thus, 

u( t ) = [F'ium-'kt), 

so u(t) depends on t continuously. 

The formal differentiation is justified if one proves that u(t) is differentiable at 
any t E [0,T], that is, 

(2.16) u(t + k)-u(t) = A(t)k + o(k), k -> 0, te[0,T], 

where A(t) G H does not depend on k and at the ends of the interval [0, T] the 
derivatives are understood as one-sided. 

To establish relation (|2.16p one uses equation (jl.ip and the assumption h 6 
C^QO,! 1 ]). One has: 

(2.17) F(u(t + k))-F[u[t)) = h(t + k)-h[t) = h(t)k + o(k), k -> 0, 
and 

(2.18) + = / F'(u(t) + s(u(t + k)-u(t)))ds(u(t + k)-u(t)). 
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The operator F' ( u(t) + s(u(t + k) — u(t))\ ds is boundedly invertible (uniformly 
with respect to k s (0, ko), where < ko is a sufBciently small number) as long as 

sup \\u(t) + s(u(t + k)- u(t)) - y\\ < R, 
»e[o,i] 

see ()2.ip . This inequality holds, as one can easily check: 

\\u(t)+s(u(t+k)-u(t))-y\\ = \\(l-s)(u(t)-y)+s(u(t+k)-y)\\ < (l-s)R+sR = R. 
Therefore, (|2~TBj) follows from (f2~T?|) and (EHHJ). Remark [2] is proved. □ 



3. Convergence of the DSM |L 
Consider the following equation 

(3.1) F(u) = h + v{t), 
where 

(3.2) u = u(t), v(t)=e' t v , v := F(u ) - h, r = \\v \ 
At t — equation (|3.ip has a unique solution uq. 



Let us make the following Assumptions B): 

(1) Assumptions A ) hold, 

(2) h£B(f,6), 5 + r<p:=t^«. 

Theorem 3. If Assumptions B) hold, then conclusions \1.7\ , with f replaced by 
h, hold for the solution of problem (|1.8|l . 



Proof. 1. Proof of the global existence and uniqueness of the solution to problem 

CD). 

One has 

\\h + v(t) - /|| < - /|| + \\voe-*\\ <S + r<p, Vt > 0. 
Thus, it follows from Theorem [1] that equation (|3. 1|) has a unique solution 

u = u{t) € B(y, R) 

defined on the interval t € [0, oo), and u(t) € C ll ([0, oo)). 
Differentiation of (|3.ip with respect to t yields 

(3.3) F'(u)u = v = -v = -(F(u(t))-h). 

Since u(t) £ B(y,B), the operator F'(u(tj) is boundedly invertible, so equation 
(|3.3[) is equivalent to (|1.8[) . The initial condition u(0) = uo is satisfied, as was 
mentioned below (|3.2[) . Therefore, the existence of the unique global solution to 
(fTgj) is proved. □ 

2. Proof of the existence ofu(oo). 

From (grp), (E3), (EI]), and Ol) it follows that 



(3.4) \\u\\ < ^-e-\ ?G(0,1). 

This and the Cauchy criterion for the existence of the limit u(oo) imply that it(oo) 
exists. □ 
Integrating (|3.4j) . one gets 

(3.5) | Wt )_ no ||< , 

1 - Q 



6 



A. G. RAMM 



and 

(3.6) || u(oo ) <_!^L e -*. 



3. Proof of the relation F(u(oo)) = h. 
Let us now prove that 

(3.7) F(u(oo))=h. 

Relation f|3.T|) follows from (|3.1j) and (|3 . 2[) as t — > oo, because u(oo) = 0, £ 

-B(y, i?), and F is continuous in B(y, R). □ 

Theorem [3] is proved. □ 

Remark 4. Let us explain why there is no assumption on the location of uq in 
Theorem|3J The reason is simple: in the proof of Theorem[3]it was established that 
u(t) £ B(y,R) for all t > 0. Therefore, u(0) 6 B(y,R). 

4. The Newton method 
The main goal in this Section is to prove convergence of the Newton method 

(4.1) u n+ i = u„ - [F'(u n )]~ 1 (F(u n ) - f), u a = z, 

to the solution y of equation (|1.2[) without any additional assumptions on the 
smoothness of F'(u). By z £ H we denote an initial approximation. 

Theorem 5. Assume that (ll.2[) - (|1.4p and Assumptions A) hold, and that 

(4.2) mu(R) = q £ (0 A gi||z - y]| < J2, gi 



TTien process (|4.ip converges to y. 
Proof. One has 

«n+i - y = - 2/ - [F'(m„)] _1 / F'(y + s(u n - y))ds(u n - y) 

(4-3) , J ° 

= -[F'K)]" 1 / [f (i/ + - y)) - F'(u n )]ds{u n - y) 
Jo 

Let 

On := IK* - a o = ||z - - 

Then dm), (O and dHJ) imply 

. . moj{R) q 

(4.4) a n+ i < — a„ < a n := gi<z n . 

1 - q 1-q 

From the assumption q £ (0, |) one derives that gi 6 (0, 1). Thus, using (|4.2[) . one 
gets: 

- := ai < qi a < R. 

By induction one obtains: 

\\u n -y\\<R, Vn = l,2,3, 

Consequently, u n £ B(y,R) for all n, and estimates (|2.ip and (|4.4p are applicable 
for all n. Therefore, l|4.4p implies 

(4.5) an^q^R, Vn = 1,2,3, 
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Therefore, 

lim a n = 0. 

n — >oc 

Theorem [5] is proved. □ 
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